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Abstract — Random matrix model for the Nakagami-<jr (Hoyt) 
fading in multiple-input multiple-output (MIMO) communication 
channels with arbitrary number of transmitting and receiving 
antennas is considered. The joint probability density for the 
eigenvalues of H^H (or HH^), where H is the channel matrix, 
is shown to correspond to the Laguerre crossover ensemble of 
random matrices and is given in terms of a Pfafflan. Exact 
expression for the marginal density of eigenvalues is obtained as a 
series consisting of associated Laguerre polynomials. This is used 
to study the effect of fading on the Shannon channel capacity. 
Exact expressions for higher order density correlation functions 
are also given which can be used to study the distribution of 
channel capacity. 

Index Terms — Channel Capacity, Fading distributions, Hoyt 
distribution, Laguerre crossover ensemble, MIMO channels, 
Nakagami-<jr distribution, Random matrices. 



I. Introduction 

THE propagation of radio waves through wireless channels 
is a complex phenomenon. Various unavoidable effects 
associated with the multipath fading make it extremely difficult 
to formulate an exact mathematical description. However, 
there exist a number of simple and accurate statistical models 
for fading channels. These take into account the particular 
propagation environment and the underlying communication 
scenario JT), 0. 

It has been shown that the use of multiple transmitting and 
receiving antennas leads to significant increase in the spectral 
efficiency of wireless communication systems (3), J4). This 
idea has been pursued vigorously in the last ten years fl3]- 
ll35l . There are now available a number of powerful results for 
the multiple-input multiple-output (MIMO) communication 
systems. The mathematical model for MIMO communication 
involves the channel matrix H, whose entries characterize the 
paths between the antennas at the transmitting and receiving 
ends. Many quantities of interest, which measure performance 
of the MIMO system, follow from the eigenvalue statistics of 
Hermitian matrix W = H^H (or HH^). H is, in general, a 
rectangular random matrix with real or complex entries, its 
dimensions being N r x N t . Here N r and N t are the numbers 
of receiving and transmitting antennas respectively. The choice 
of probability distribution for H depends on the propagation 
environment and communication scenario. When the matrix 
elements of H are independent and identically distributed (iid) 
Gaussian variables with zero mean, the ensemble of W is 
referred to as the Wishart or equivalently Laguerre ensemble 
ED, G3, EH, EH, E0), ETJ. It has also been referred to 
as the Dyson ensemble [42, |43l . 
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The performance of MIMO systems with iid channels has 
been investigated extensively. The assumption of iid channels 
holds good when there is sufficient spacing within the antennas 
at either ends. Two important examples are the Rayleigh and 
Rician fadings with uncorrelated channels, where the matrix 
elements of H are taken to be iid complex Gaussians with zero 
or non-zero means respectively. These fading models apply to 
the cases with absence or presence of a strong direct line of 
sight in the propagation paths between the transmitting and 
receiving ends. Telatar [4] has considered the uncorrelated 
Rayleigh fading in great detail. His paper has been followed 
by many authors; see for example (6), 0, J8|. Rician 
fading with uncorrelated channels has been studied in [|9l , 
flOl . In recent investigations the condition of iid channels has 
been relaxed and the effects of spatial correlations has been 
considered ifTTI . (12 J, 1 13 1, [ 14|. This is needed to take account 
of closely spaced antennas at either or both the transmitting 
and receiving ends. 

The general problem of multichannel communication has 
been considered by Simon, Moustakas and others |Q3], [16|, 
El, ifTHl by group theoretical methods to obtain exact results 
for both uncorrelated and correlated cases. See also [19] and 
[20] respectively for other ensembles and another approach to 
the problem of fading in MIMO channels. 

Most of the research related to MIMO capacity has fo- 
cused mainly on Rayleigh and Rician distributions. However, 
there are other classes of fading distributions which serve 
as better models under certain circumstances. An example is 
the Nakagami-m distribution which contains Rayleigh, one- 
sided Gaussian and uniform distribution on unit circle as 
special cases 11211 . [22], |23|. Another example is the Weibull 
distribution which has been considered in [24- 1 . 

Our purpose in this paper is to study Nakagami-g dis- 
tribution ID, J2), ETJ, flB], ED with iid channels. This 
model was proposed by Nakagami as an approximation to the 
above mentioned Nakagami-m distribution for certain range 
of m values JTJ, EJ, EH . |23l . It has been investigated 
independently by Hoyt [25], and hence is also referred to as 
Nakagami-Hoyt fading. Under this fading the elements of H 
are taken to be complex iid Gaussians with zero mean, but 
in general having different variances for real and imaginary 
parts. It spans the range from one-sided Gaussian to Rayleigh 
distribution as the value of parameter q is varied from to 1 . 
Note here that one-sided Gaussian fading occurs in the limit 
when variance of imaginary (or real) part is zero, whereas 
Rayleigh case is obtained when the variances of real and 
imaginary parts are equal. This fading is observed on satellite 
links which are subject to strong ionospheric scintillation flTJ, 
E), ll27ll . It has also been used to analyze the cellular mobile 
radio systems l28l. ll29l. 

In the context of random matrix theory Rayleigh fading 
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corresponds to the Laguerre unitary ensemble (LUE) 
[ 39 1, [40|, BP of random matrices, whereas one sided Gaus- 
sian fading corresponds to the Laguerre orthogonal ensem- 
ble (LOE) of random matrices ED, ED, ED, ED- Thus 
Nakagami-g fading, in general, corresponds to a random 
matrix ensemble which interpolates between LOE and LUE. 
This crossover ensemble, along with the more general Jacobi 
crossover ensembles, was recently studied by the present 
authors P4l . |45l . In this paper we apply the LOE-LUE 
crossover results lf44l to solve the problem of Nakagami-g 
fading. The crossover results follow from the Brownian motion 
formalism of random matrices [42], [46 1 . This approach is 
equivalent to the group theoretical formalism mentioned above 
and has been briefly described in Appendix A. 

The Nakagami-g fading results for N t = N r = 2 were 
obtained recently by Fraidenraich et al. [26]. These results 
were presented in terms of complicated multiple integrals. In 
the present work we obtain exact results in compact forms 
for all N t ,N r . We obtain the JPD of eigenvalues in terms 
of a Pfaffian [39| (See Appendix B) from which all density 
correlation functions can be derived. In particular the level 
density, which is proportional to the marginal density, is 
given in terms of a series consisting of associated Laguerre 
polynomials. We use this to study the mean or ergodic capacity 
of MIMO channels for Nakagami-q fading. The higher order 
correlation functions can be used to study distribution of the 
channel capacity ED, PP . 11321 . Il33ll . These exact results 
serve as interesting addition to already existing rich literature 
in this field. 

The paper is organized as follows. In Sec. [EI] we describe the 
Nakagami-<7 distribution. Sec. [Ill] deals with the Nakagami-g 
fading in MIMO systems and gives the LOE-LUE crossover 
results. Some of the details of the derivation are given in 
Appendices A, B, C and D. In Sec. [IV] the effect of this fading 
on Shannon channel capacity is investigated. We conclude with 
some general remarks in Sec. [V] 



II. Nakagami-<7 Distribution 

The instantaneous signal in Nakagami-g fading is modelled 
as the complex Gaussian quantity 



Z = X+jY = R(J e , 



(1) 



where X, Y are zero mean Gaussians with variances a\ and 
a Y - The distribution of the signal envelope R = \Z\ is 
obtained as l2ll. |251 



pr(R) 



qCl 



R 2 ), (2) 



where 7o(-) represents the zeroth order modified Bessel func- 
tion of the first kind. The distribution of phase 8 is given by 



a x ay 



2ir(a x sm2 ^ + a Y cos2 1 



-n<9<ir. (3) 



In © q G [0, 1] is the Nakagami-Hoyt fading parameter, and 
fl = E[i? 2 ] = a\ + a Y . E[-] is the expectation operator and 



represents the statistical average. The parameter q is given in 



terms of the variances a\ and a Y as 



cry /ax, a x > cry 
cx/ctYi cry > &x 



(4) 



Thus we have q = for ay = (or ax = 0), the other 
being nonzero, and q = 1 for ax = &y- These correspond 
respectively to one sided Gaussian and Rayleigh fadings. Note 
that the q = case is referred to as one-sided Gaussian 
because the signal amplitude (f2]) corresponds to that of \X\ 
or \Y\. 

For definiteness we choose ax > cry - Note then that the two 
cases in (|4| correspond to the distribution of Z and Zj\ . The 
Brownian motion parameter r ll44ll which governs the LOE- 
LUE crossover (see Appendix B) is related to the quantities 
defined here in the following way: 

\ l-q 2 



e -r = U X - U Y 

a\ + al 

which is also the parameter b in 
write 



1 + q z 

Alternatively we can 



'x 



1 



i 



n. 



(6) 



The crossover results in ||441 correspond to the choice SI = 
1/2. Also, r = corresponds to LOE whereas r — > oo 
corresponds to LUE. These limits lead to one-sided Gaussian 
{q = 0) and Rayleigh (q = 1) fadings respectively. 

III. MIMO Channel Model and LOE-LUE 
Crossover 

We consider a single user Gaussian channel with Nt anten- 
nas at the transmitter end and N r antennas at the receiver end. 
The MIMO channel can then be modelled as |4] 



y = Hx 



n 



(7) 



Here x and y represent the (N t and N r dimensional) trans- 
mitted and received signal vectors respectively, n is complex 
Gaussian noise vector with zero mean (E[n] = 0) and unit 
variance (E[nnT] = Ijv r ). H is N r x N t dimensional channel 
matrix with iid entries Hjj~ distributed as the random variable 
Z given in ([T). Equivalently H can also be written as 



H = H X 



(8) 



where Hj and Hy are independent N r x Nt real ma- 
trices with zero mean iid Gaussian entries with variances 
a\ and a\ respectively. Now consider N=min(N t , N r ) and 
M=max(N t , N r ). The Hermitian matrix 



W = 



H'H for N r > N t 
HHt for N r < N t 



(9) 



is therefore N x N dimensional. 

As mentioned in the introduction the matrix model given 
by (|8]l maps to the random matrix problem of LOE-LUE 
crossover [44|. The JPD of eigenvalues {A} = (Ai,...,Ajv) 
of W for this crossover can be obtained using the Brownian 
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motion model of random matrices [42 1, [46|. Proofs are given 
in Appendices A and B Q. We find that |44| 



JV 



nra JV(JV-1)t/2 

P(W-M;t) = ^ N(N+1)/2 C^A N Pf[F^}l[w a 

1=1 



( ._><>) i!V-l]2' \ - ^ 'L- .,./, 11 " a ( 2 £l)' 

(10) 

Here Pf(B) represents the Pfaffian of an even-dimensional 
antisymmetric matrix B [39| (see Appendix B for definition), 



°7V — 



N/2 



N 

n 



i 



2N i i 1 r(l + 1 ) r d + ^ i ) 

is the normalization, 

Ajv = Ajv(Ai,...,Ajv)= Y[ (Aj-Afe) 

l<j<fe<JV 

is the Vandermonde determinant and 



w a (x) = x a e x , 



< x < oo, 



(11) 



(12) 



(13) 



is the associated Laguerre weight function. The parameter a 
is defined by 

2a + 1 = \N t -N r \. (14) 

F( T ) is a 2m-dimensional antisymmetric matrix with 2m = N 
or N + 1 depending on whether N is even or odd. The matrix 

(t) 

elements Fj k ' are obtained from their r = counterparts us- 
ing the one-body operators introduced in P4l (See Appendices 
B and C). For j,k = 1, N we have 



For odd N, we have in addition 



(15) 



F 



(r) 



J,iV+l 

With L^(a;) representing associated Laguerre polynomials, 

G^ T \x,y) and u/ r )(x) are given by 

<? (T W) 

OO OO 

= 2 Wa+1 (x) Wa+1 (y) J2 E ^ +2V+1)T ^1 

4 2 ; +1) ( 2 -)4 2 , a + + 1 1) (2 2 /) - Lg\\ 1 \2 X )L^\2y) 

OO 

2 Wa+1 (x) Wa+1 (y) £ E e-^ +2 " +1 ^S 

^=0 i/=0 

4r i) (2^)4 2 ; + + 1 1) (2 2 /) - Lf;£\2 X )Lt a+l \2y) , 

(17) 



where 



and 



_ (o) _ T{y.+ \)Y{u+l) 



T(fi + a+ |)r(i/ + a + 2)' 



(18) 



OO — 2/J,T"p/ I 1 \ 

= „ a+1 (x) £ e ^y 4 2 ; +1) ^)- d9) 

'Appendix A also gives the JPD of eigenvalues for uncorrected Rician 
MIMO channels ['16 1 which arises as an intermediate step in our derivation. 



The two representations of Q^ T \x, y) appearing in (fTTT i follow 
from each other by changing the order of the two summations; 
see appendix D. Also note that Q^{;x, y) is an antisymmetric 
function of x and y. As explained in [44|, [45], these results 
valid for arbitrary r derive from the r = results for which 

g {0 Hx,y) = h g n(x-y), (20) 



and 



J°\x) 



(21) 



For r = (q = 0) and r = oo (g = 1) equation ( fTOb reduces 
to the following well known results for the LOE and LUE 
respectively ED, (37), EE ED, HO, ED, 132, 



p({x} ; n ; o) = 



p({x};n ;oo ) 



i 



(2n) N ( N + 1 )/ 2 ~ N 

1 -,(00) 



A, 



1=1 

The normalization Cjy is given by Eq. CD) and 
■,(00) T-r 1 



A' 



' N 
N 

n 



L i r(/c + i)r(fc + 2a + i) 



(22) 

(23) 
by 
(24) 



Equation d221 i applies to the one-sided Gaussian fading, 
whereas d23l applies to the Rayleigh fading. The latter is 
considered in [0] with the choice Q. = 1. 
The n-level correlation function defined by 

#n(Ai,... 1 A n ;fi;r) 



(iV-n)! 



/•OO /• 00 

/ ... / P({A};^;r) 
Jo Jo 



x dA n+ i...dA 



jV 



(25) 



can be expressed as a quaternion determinant involving certain 
two-point kernels, which in turn derive from skew-orthogonal 
polynomials and their dual functions go), ED, MM, E3. The 
explicit forms have been given in Appendix C. Since we are 
interested here in the calculation of channel capacity, which 
is a linear statistic on eigenvalues, we need i?i(A; ft; r) only. 
We find, 



#i(A;0;t) = i?i(A;ft;oo 
1 /A 



1 /AN ( 2a +l)/A 

i> + i-|) 



E - 

,_(J_+c) 



-(2t/+2— N-c)t 
22a+l 



where 



r(^±|2±±)i> + a + 2 



c = /V(mod 2) 



-L 



(2a+l) 



S ), (26) 



(27) 



A proof of ( |26| | is outlined in Appendix D. In the limit r — >■ 
00 the second term in d26| i vanishes. The first term gives the 
density for the Rayleigh case (LUE result), viz. 



i?i(A;fi;oo 
1 

= n 



W2a+1 (o) 



An^ 1 



r( M + i) 



m=o yr 



2a + 2) 



(28) 
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(a) N t = 2, N r 



(b) Nt = 3, N r = 6 
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Fig. 1. Marginal density of eigenvalues p(A;Q;r) for Q = 1 and several combinations of Nt,N r . The inset gives the q values which is related to r by 
j5J. The lines are theoretical predictions w here as the symbols are simulation results. In (d) we have avoided simulation results for clarity and instead given 
the asymptotic result calculated using Eq. 133) . 



For r = d26j i can be reduced to a finite sum involving 
incomplete Gamma function T(s,x) = J y s ~ 1 e~ v dy along 
with the associated Laguerre polynomials, i.e. 

i?i(A;ft;0) = i?i(A;ft;oo) 

N 



A \ 

/, + " L 2oJ 
(29) 



with 



(a) _ (-l)M 2 M+2a+l ( jy + 2 g + l)r(jV + 1) 

Xjv ^ r( M + 1)I> + 2a + 2)r(7V - /i + 1) ' ( ' 



r(E+l\ 



and 



r(i 



(Q) _ 2 2a r(7v + i)r( jV + 2 2 a + 2 ) 

Vn ~ r(7V + 2a+l)r(^±2) ' 



(31) 



(32) 



Note that for r^0 the series in ( 1261 1 converges very rapidly 
because of the presence of exponential factor. For r = 
equation d29l is more useful for numerical considerations than 



For large N the first term in (126t dominates over the second 
and so the density becomes independent of r (or q) and is 




20 

Power (dB) 



Fig. 2. Channel Capacity vs Power for q - 
values with Q = 1. 



: and q = 1 for several Nt X N r 



described by the Marcenko-Pastur-Dyson density ll42l . 11471 . 

ma, 



\J (A ma x ~ X)(\ — A m ; n ) 



, 



otherwise. 



MO(l- y/N/M) 2 and A„ 



(33) 



H ere A m j n = 

The marginal density p(X; fl; r) = Ri(X; f2; r)/iV (normal- 
ized to 1) has been shown in Fig. 1 for different N t ,N r at 
various q values. The theoretical predictions based on (l26t 
and the results of numerical simulations for the matrix model 
given by ^ are in excellent agreement. In Fig. 1(d) for 
Nt — N r — 16 the density curves for q = and q = 1 
almost overlap and are well described by (|33"V 

We would like to remark here that it is difficult to analyti- 
cally demonstrate the equivalence of Nt — N r = 2 results in 
1 26 1 with our corresponding results. However the agreement 
of theoretical predictions with numerical simulations in both 
cases show that our results are equivalent. 

IV. Shannon Channel Capacity 

In the absence of channel knowledge at the transmitter end 
the ergodic MIMO channel capacity is given as [4] 



C = E 



JV 



i 



—A, 



NE 



!og 2 1 



-A 



(34) 



Here V constrains the total transmitted power as Efx^x] < V. 
Since P({X};fl;T) is symmetric in all the eigenvalues the 
ergodic capacity can be obtained from the level density 

i?i(A; Q;t) as 



C = 



log 2 1 



i?i(A;fi;r)dA. (35) 
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Fig. 3. Channel Capacity vs q at (a) V = 15dB and (b) V = 30dB for 
several Nt = N r values with f! = 1. 



It is possible to carry out this integral explicitly by considering 
the expansion of associated Laguerre polynomials in (1261 . as 
done for the Rayleigh fading in [8|. The final result would 
involve a triple summation. We present here the results by 
carrying out the integration in (l35l numerically. 

Fig.|2]shows the channel capacity for various values of Nt = 
N r in the extreme cases, i.e. for q = and q = 1. The 
result using asymptotic density is also given. The effect of the 
Nakagami-Hoyt parameter q on the channel capacity is shown 
in Fig. [3] for several N t ,N r values at V = 15dB and 30dB. 
The degradation in channel capacity can be clearly seen as q 
decreases from 1 to 0. For example, at V — 15dB the channel 
capacity is found to degrade upto 8.33%, 5.96% and 4.63% in 
N t — N r — 2, 3, 4 cases respectively. Fig. |4]shows the relative 
degradation in the channel capacity, 1 — C(q = 0)/C(q = 1), 
as a function of V. 

V. Conclusion 

We have shown that the problem of Nakagami-q fading 
in MIMO channel can be effectively and exactly handled 
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Fig. 4. Relative degradation vs V for several values of Nt = N r with 
Q = 1. 



by considering the Laguerre crossover ensemble of random 
matrices. Employing the techniques introduced in ll44l we 
have given exact expressions for the JPD as well as density 
correlation functions of all orders. The level density of the 
eigenvalues is presented in terms of a series consisting of 
associated Laguerre polynomials and is used in the calculation 
of Shannon channel capacity. The higher order correlation 
functions will be useful in studying the distribution of the 
channel capacity QUI. I3T1. l32l. l33l. 

The present formalism can also be used to solve the problem 
of uncorrelated Rician fading in MIMO channels, as indicated 
in Appendix A. It would be of interest to extend it to deal 
with the cases of correlated channels and also to consider 
the phenomena of keyhole or pinhole channels which arise 
because of degenerate channels 11221 . (34), 12). 

Appendix A 
Brownian Motion of Laguerre Ensembles 

For the Brownian motion model of the Laguerre ensembles 
it is convenient to work in terms of the parameter r which 
serves as a fictitious time ||46l . It is related to the parameter 
q as given in (0. At r = the matrix H will have only 
real Gaussian elements, whereas for r — > oo it will have 
complex Gaussian elements with equal variances for the real 
and imaginary parts. In the following, without loss of any 
generality, we take H to be M x N dimensional with M > N. 

The matrix model given by dHJ is statistically equivalent to 
the following matrix model 



H(r)=e- T / 2 1 /2 A . 



1 



1/2 



(36) 



where A belongs to the ensemble of real matrices with iid 
Gaussian elements having zero mean and unit variance. V is 
a member of the ensemble of complex matrices having iid 
Gaussian entries with zero mean and unit variances for both 



real and imaginary parts. At r + St we have 



1 - e 



-T-5r\ 1/2 



(37) 

As far as eigenvalue properties are concerned, ensemble of 
matrices described by ( l37| > is again statistically equivalent to 
the ensemble of matrices defined by 

H(r + <5r) = ao(H(r)+eV), (38) 

where V belongs to the same ensemble as V, and ao and e 
are given by 

' (39) 



ao = e- &T ' 2 = 1 - -St, 



and 



1/2 



(St) 



1/2 



(40) 



Here in (|39l and (l40l as well as other equations below the 
expressions are correct upto order St. Considering the singular 
value decomposition U{H(r)U2 = X(r), we obtain from 



1/2 



X(r + St) =11- ^St) X(t) + 1^1 (St)^ 2 V. (41) 

Here X(r) is M x N dimensional real rectangular diagonal 
matrix. V(= U{VU2) has the same statistical properties as 
that of V. Thus we have 

X T (r + St)X{t + St) = (1 - <5t)X t (t)X(t) 
+ (X T (r)V + VtX(r)) (-St) V * + ^VSt. (42) 

Note that the singular values of H are square roots of eigenval- 
ues {A(t)} of ELH. As mentioned above the eigenvalues {A} 
are statistically equivalent to those of W = H^H. Similarly 
the eigenvalues {A(r + <5A)} correspond to the squares of the 
singular values of H. Applying the second-order perturbation 
theory we get, 



n„ \i/2 



SX 3 (t)^X 3 (t + St)-X,(t) 

- -X 3 (t)St + (MT)y/ 2 (V n (T) + V*j(T)) (^St) 

M „ 
-EWV kj (T)(- 



St 



k=l 



A \{^{T)f/ 2 % k {T) + (X k (T)Yl 2 V* 3 {T)\ 2 ,Q \ 
^ Xj(t) - Afe(r) \2 dT J- 



fc(^i)=i 



Since 



E[V jk ] = 0, E[V* k Vi m ] = 2SjiS km , 
we get, for the eigenvalues {A}, the following moments 



(43) 
(44) 



N 



EiSXj] = ( -Xj+(M-N+l)fl+ 
and 



2S1A, 



E[8XjSX k ] = 20 XjS jk St. 



A, — Aj 



St, (45) 



(46) 



7 



Using these we can construct the Fokker-Planck equation for 
the JPD of eigenvalues 11391 l42l, |46l, |49l. 



dP 



-LP, 



(47) 



where C is the Fokker-Planck operator given by 



2Xa 



A, 



(48) 



The equilibrium density corresponds to LUE (Rayleigh) and 
can be verified by setting CP e0t = 0. 

Using the similarity transformatiorjl £ = Peq 1 ^ 2 P, we map 
( |47| | to a Schrodinger equation in imaginary time it, We get 



(49) 



Here U - p-VVpVa 
interacting fermions and is given by 



P eq L/ *£Pec[* describes a system of N non- 



N 



H 



i 



AT(iV-l), 



(50) 



where Ha is the single particle Hamiltonian, 

' ix OV ' OX IQ 2 4 A 

(M-N + l) 
+ 2tt 



(51) 



The eigenfunctions of H.\ are the weighted associated 
Laguerre polynomials [(X/n) M - N e- x / n }^ 2 L { n M ' N) (A/O) 
with corresponding eigenvalue n, where n = 0,1,2,... . The 
eigenfunction £ of "H is thus the Slater determinant comprising 
these weighted polynomials. Also note that the ground state 
energy of H is zero. 

The JPD of eigenvalues at arbitrary r can be obtained as 

P({X},t) = e- CT P({X},0) = P e y 2 e- Wr P eq 1/2 P({A},0). 

(52) 

This expression is equivalent to 

rOO pOO 

P({X},r) = d 7 i---/ d 7J vP({A};r|{ 7 };0)P({ 7 },0), 

J ° J ° (53) 

where P({A}; r|{ 7 }; 0) is the conditional JPD (or Green's 
function or propagator) which gives the probability of finding 
the eigenvalues {A} at r when the initial eigenvalues are { 7 }. 
We have PRO 



P({A}:H,}:(., = ''- P " ({A}, ^ J " 



P=q(M) 



-S n T 



UW)UM), (54) 



2 The same transformation applied to a more general ensemble with real and 
quaternion-real matrices leads to a Calogero-Sutherland type of Hamiltonian 

ED. 



where the sum is over all the states. £ n is the eigenvalue 
corresponding to the state £ n ({A}). Substituting the Slater 
determinant form of £ we obtain 



P({A};r|{ 7 };0) 



1 Ajy({A}) 
n»N\A N ({j}) 
A 



■' \2fl' 20' 



N ^ 

i=i 

r) 



i,k=l, 



N 



xe N(N-l)r/2 dct 

where (50) 

OO —LIT 

f{x,y-r) = £ G L^\2 X )L^\2y) 

. ,'4(-xye- T ) 1/2 

<J2a-\ 



(55) 



= -2( a; +y) e - T /(l-e" T ) 



(1 - e- T )(-4xye- T ) a + 1 /2 
Jfe(z) is the Bessel function and 
T(p + 2a 



1/2 



(56) 



(57) 



r(/i + 1) 

Eq. ( T55t is similar to the expression obtained after integral 
over unitary group ifTBI . In the present problem we use it 
to solve the Nakagami-g fading problem. However it can be 
used to tackle other fading distributions also. For example, the 
uncorrected Rician case can be solved by taking A in (|36| > 
as a fixed matrix instead of belonging to an ensemble of real 
Gaussian matrices and properly adjusting the values of £1 and 
r. 

Appendix B 
JPD for LOE-LUE Crossover 

To find the JPD for LOE-LUE crossover we need to 
substitute for F({A};0) the JPD for the LOE. We can use 
either (l52l or (l53l to accomplish this task. It turns out that it 
is advantageous to use (l52l as it leads to the final result in 
fewer steps B4l . This is done by expressing (l22l in terms of 
a Pfaffian. 

The Pfaffian of a 2m x 2m antisymmetric matrix B is 
defined as [39] 



Pf[B] — ^ a p Bi lt i 2 B i3tii ■ ■ ■ B i2m _ 1 s 



(58) 



The sum in ( 1581 is over all permutations 

1 2 ... 2m 

h i-2 ■■■ hm 

with the restrictions i\ < %2, «3 < «4, iim-x < i?.m\ 
H < *3 < ••• < *2m-i and a p is sign of the permutation. 
Also, Pfaffian is related to the determinant as 



det[B] = (Pf[B]) 2 . 
Thus we can write P({A}; 0) as 



TV 



P({A};0)ocA JV Pf[F] fe ) ]J] U ; 



i=i 



29. 



(59) 



(60) 



where Fr) is given using ( fTBI l, ( [TBI , ( f20l > and ( t2TT >. 
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Using d50b and d52l we get Thus we get infinite series representation for u/ '(x). Appli- 

C N . cation of operator O on r = results, as given by (|64l and 

| TT q x jpf^ '] ] (l65T l, then leads to the expressions ( fTTI i, ( fT9b of £ and w valid 

/ ^ / for arbitrary r. 

x Il u;a (^)' ^ 61 ^ Appendix C 

i=1 Skew-orthogonal polynomials and density 

where we have introduced the one-body operator 0\ given by CORRELATION FUNCTIONS 



We give here the results for 17 = 1/2 and, by a simple 
£^ _ V W2a+1[ -ti) c -u x t Wa ^2U^ rescaling, obtain results for arbitrary fl. 

Wa(^j) \/if2o+i(n) ^ 6 we ^ ntec ' skew-orthogonal polynomials (x) and 

their dual functions ^^(ir) satisfy the following relations 
(39), KD, ED, EU, 11451: 



We will also need 



T , , ^ , . , .. , a u (2a+i), an ip^ (x) = G {t) (x, yU^ (y) dy. (71) 

The operator U\ has eigenfunctions w a+ i(^)L^ r J w Jo ' y/v ^ vy/ y v y 



n i .... , 

■ > | Here 
, 1 jn) i M a+i, (n) with eigenvalues e^ T . Eq. (|T0) is then f ^ j eve n and fc = j + 1, 



with eigenvalues e AlT , whereas {0\) has eigenfunctions 
obtained using the expansion of Pfaffian with 



Zj^ = \ — 1. j odd and fc = j — 1, (72) 
= O x O^(a;,y), (64) ( 0, otherwise. 

and When N is odd we have an extra condition: 

w (t) (.t) = O x uj {0 \x). (65) 



The antisymmetric function Q^{x, y) = ^sgn(a; — y) can 



wW(x)<pf'(x)dx = 5 jlN -i. (73) 



be expanded in terms of the functions dual to the weighted xhe T . dep endent expressions for and tp are obtained by 
skew-orthogonal polynomials (40), ED, El. as defined in operating ( t)-l and 0k on their T = coun terparts as El 



Appendix C. We have 

oo 



^\x) = {Olr 1 ^(x), (74) 

and 

i>P(x) = O x ^(x). (75) 



We use r = expressions for skew-orthogonal polynomials 

and their dual functions from E0), ED- The r-dependent For even N we find 
counterparts given in Appendix C are their generalizations for 2 a+1 / 2 

the crossover problem iU. ~ <^(x) = w a {x)e 2 ^L^ +1) {2x), (76) 

The expansion of u^°'(x) — | is obtained by writing it as 
1 Jo°° 3(x ~ y) dy and using 



oo 

5(x -y) = w a+1 (x)w a (y) £ — L^ 1 ^)^ 1 ) (2y) 



2a+3/2 



^'W = Wa+l(x)^2 [ e 



-(2i/+1)t 



CK2U 



M „_ i> + i)ry + a + i) T (2a+i) 



2T( l , + a + 2)r( / i+l)^+ 1 (2X)J ' (7?) 



(67) 

The integration over this expansion of delta-function is accom- 
plished by recursively using the following important relation 

which holds for nonnegative integers fi ED, ^Ldx) = ?—^w a {x) \e^ +1 ^(2fx + l)L^+ 1 \2x) 

d 1 a2t * 

-[w a+1 (x)L^(2x)} = - Wa {x)[A, +l L^ 1 \2x) _ e (^)r { ^ + 2a+1)L ^) {2x) ^ (78) 

-B ll _ 1 L^+ 1 \2x)], (68) 

2 a + 3 / 2 

with = [j,, Bf, = n + 2a + 2, = 0. We find 4u+i(^) Wa+i(x)e" 2A1T il 2 u a+1) (2a;), (79) 

a2/i F 



r(f + o + i) 



/i even, for /j, = 0,1, 2, ... . For odd N these are given by 



w a {y)L^ +1 \2y)dy={ T(f + 1) 

u ode 

(69) ^ w = ^77 u/ ^ x "^' ' • ^ 



°' ^° dd ' = — Wa (x)e^L%£\2x), (80) 
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4 T >) = 



2<i+3/2 

r(i/ + |)r(M + Q + |) (2g+1) 
^r^ + a + Dr^ + f)^ (2 ^' (81) 



2Q+1/2 

'< 

<*2^+l 



>a(x) [< 



3 (2 M +2) 



T (2 A1 + 2)4 2 ; + + 2 1) (2a:) 



e 2 ^(2 / i + 2a + 2)4 2 ; +1) (2a ; )], 



2a+3/2 



(82) 



^x^e-^+^^^^x), (83) 

for /i = 0, 1, 2, (iV - 3)/2. The unpaired for odd N is 
given by 



Jr W) 



^(s) = 2w a (x)e^ \^ N+ 2 J 1 - L^\2x), (84) 



with its dual 

oo 

^Ux) = -2w a+1 (x) [e- (2U+1) 



I> + 1) (2a+l) r si 

X r(^ + a + 2)^ +1 ™" (85) 

Using these weighted skew-orthogonal polynomials and 
their dual functions we define the following two-point kernels 



(x, y) = e (y) - 4;Vi fo) 



p=0 



(Olr'OyS^^y), 



(86) 



/j=0 



(Otr^Ot)- 1 ^*,*/), (87) 



OO 



c[^iW« (T) (i()-^i(y)w (T) W] 

O x O y B%\x,y), 



In particular the level density is obtained as 

72.1 (x; t) = S^\x, x). 



(91) 



The correlation function Rn(Xi, A n ; O; r) of (l26l i is ob- 
tained by rescaling as 



i?„(Ai, ...,A n ;0;r) 



/ Ai A„ _ 
(20)" V2?7' '"' 2S1 ' 



r). (92) 



Appendix D 
Proofs of equations (fTTI ). ([26l i and 



G^ T '(x,y) is obtained by direct substitution of -i/^^s in r- 
dependent analogue of d66l i which is similar to 
The first expression in (fTTt follows by using ((79) and ( |77| >, 
whereas the second expression is obtained by using (l83l and 
( |8TV As expected these two expressions are equal and follow 
from each other by changing the order of summation. 

Now we outline the proof of (l26T i. For even N we get 



x E ^4 2 ; +1) (2x)4 2 ; +1) (2y), (93) 

and after some algebraic manipulation, 

l£_l 

E - -2 2a+2 ™ a (tfK +1 ( y ) 

Ai=0 

xE^4 2 ; + + 1 1) (2x)4 2 ; + + 1 1) (2 y ) 

M=0 "2^+1 

00 „-(2iy+2-jV)r 

-2 2o + 2 «; a (a ; ) U ; 0+1 ( 2/ )L^+ 1 )(2x) ]T 22a+1 



r(£±i)r(i/ + i) 



- r( jv+2a+i )r(i , + fl + 2) -4l a +i 1) (22/)- (94) 

Thus subtracting ( |94l from (|93l we get the kernel Sjy (a:, y). 
For odd N we have 



(88) 



Recall that c = N (mod 2). Using Dyson's theorems [39 1 we 
can write the n-level correlation function defined by (l25l l as a 
quaternion determinant involving these kernels, viz. 

Hn(xi,...,x n ;T) =Qdet[a( T >(xj,Xk)]j,k=i,..,n, (89) 
where (x, y) is given by 



a^(x,y) 



Stf( x ,y) A%\x,y) 
B%\x,y) S%\y,x) 



(w-i) l 

E 4 T J(x)4lU.y) = 2 2a+2 w a (x)w a+1 (y) 

(w-D i 



(90) 



E 



i 



^i^( 2a; )4 2 ; + + 1 1) (2y), (95) 



3 Just like the Pfaffian, the square of the quaternion determinant of a "self- 
dual" matrix is the ordinary determinant of the corresponding 2N X 2N 
matrix. See |39 | for details. 



,0 "2^+1 

4 Or equivalently by first writing the expansion of (x, y) and then 
operating O^Oy. 
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while 



(w-i) 



(w-i) 

= -2^w a (x)w a+1 (y) ± -^i£ a+1) (^)< a+1) (2W) 



ju=0 



-2 2a+2 Wa (x) U ; a+1 ( 2/ ) J L^+ 1) (2 2 :)E 



00 -(2i/+l-JV)r 



r(^±i)r> + ±) r(2a+1) 



r(ix+|a±i)r> + a + f) 



A gain S^\x,y) is obtained using 

The even and odd results can be combined in a single 
expression as 



2^w a (x)w a+1 (y) £ -L^+i)(2a;)Lf +*)(2y) 

00 -(2v+2-JV-c)7 

2 2a+2 w a (x)w a+1 (y)L% a+ 1 1 \2x) £ 



22a+l 



• " j ^ e (2»). (97) 



iV+2a+l 



r(i/ + o + 2- f) 



This equation generalizes the LOE result given by Widom llBTl 
to the Laguerre crossover ensemble. The level density in 
is obtained using ( |9"TT > and j92l . 

To prove ( 1291 we consider the function 



1 f°° 

Zn{x) = - J sgn(a; - y)w a {y)L% a+1) {2y)dy 



-1 poo poo 

-J w a {y)L% a+1 \2y)dy - J w a (y)L% a+1) (2y)dy. 

(98) 



The first integral in second line of above equation is given 
using the result (l69l . The second integral can be evaluated 
to a finite series involving incomplete gamma functions. This 
is accomplished by using the standard expansion of Laguerre 
polynomials [50] 



4 fe) (*) = £ 



thereby giving 



(-l)T(n + fc+l) x» 
T(k + n + l)r(n -n + l)T(ji + 1) 



, (99) 



l N (x) 



rtf+o + i) 
2r(f + 1) 



<5c,0 



A' 



(_l)M2AT(jV + 2a + 2)r( M + 0+1,0;) (]()()) 



r( M + 2a + 2)r(7v - (i + i)r(/z + 1) 



Now for even N, by using ((68) and performing partial inte- 
gration repeatedly we can obtain for Zjv(x) an infinite series 



consisting of odd-order Laguerre polynomials 0. This infinite 
series is proportional to the infinite series appearing in (|26] l for 
r = 0. By adjusting the factors we get the representation (129} 
for LOE. For TV odd cilj(°'(x) + C2%n(x), with appropriate 
factors ci and c%, gives rise to an infinite series comprising 
even-order Laguerre polynomials which is proportional to the 
one appearing in (l26l l for r = 0. Again by introducing suitable 
factors we obtain 



(96) 
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